FINITE SIZE EFFECTS FOR THE DILUTE COUPLING DERRIDA 

MODEL 



On 



X 



large Allakhverdyan A.E., Saakian D.B. 

Yerevan Physics Institute 
Alikhanian Brothers St. 2, Yerevan 375036, Armenia 



1 Saakian @ vxl.YERPHLAM 

' Abstract 

> 

■ We consider paramagnetic, spin-glass and ferromagnetic phases. At T = model 

O . 

gives for the some values of connectivity (near the critical) extremal suppression of finite 

\Q ■ 

O \ size effects (decoding error probability). 

ON 

1. Introduction Derridas's model ffl is the simplest among the spin-glasses. It 
has solved in the first level of replica symmetry breaking ||. 

May be this is the origin of unique feature-condition for the appearance of ferromag- 

o 
o 



netic phase coincides with the constraint of Shannon for the optimal coding. 
This hypothesis || have proved for the general case in [[| . || 
The physical meaning of codes in the approach of Sourlas is this: 
The N numbers & are given, taking values ±1. 

By means of them we construct Z numbers Ti(Z > N), then formulate some function 
of iV discrete variables cij 

HfaTj), (1) 

which has as constants Z couplings Tj, 

There is a restriction, that single global minimum is configuration 



& (2) 



It is a simple to construct such function, but then in our problem appears noise. Our 
couplings 7j with probability conserve their sign, and with probability change 



it. Again there is a restriction, that configuration (|2|) still is a single vacuum for the noisy 
couplings Tj. 

It is possible to do this procedure only for the some (good!) choice of function H. 
For this case information theory gives restriction || 

Z[\n2-h(m)] > N\n2 (3) 

where for the entropy we have 

. , 1 + m 1 +m 1 — m , 1 — m 

h(m) = In In (4) 

v ' 2 2 2 2 w 

Really our condition (single vacuum) is correct not with probability 1, but a little less: 

1 - a exp[-E(m, N/Z)Z] (5) 

The second member is just the decoding error probability. 

On the language of statistical physics we will investigate magnification at T = 

< > (6) 

This expression gives probability, that our condition is fulo fild. So decoding error prob- 
ability is equivalent to finite size effect in the expression of magnetization 

In such manner we have coded our original information- iV numbers to noisy number 
Tj. We can rederive original values of iV numbers £j, searching (by Monte-Karlo) minimum 
of function Hfa, Tj), 

We want extremely suppress decoding error probability. 

The information theory gives restriction for the maximal value of function E(m, R), 
where 

R = N/Z (7) 

is a rate of information transmission. 

On the finite size effects have calculation at T = for the full connectively case in 
Derrida model, which corresponds to limit 

Z/N ^ oo m->l/2 (8) 



On the || has investigated fine structure of ferromagnetic phase, and has found some 
subphases, which differs each-others by finite size effects. 

In this work we are going to calculate finite size effects for paramagnetic, spin-glass 
and ferromagnetic phase. For that purposes we are using methods of ||. 



1 Derivation of REM with weak connectivity 

Let us consider hamiltonian 

H = - Yl T h-i P cr h---°i P (9) 

(ii— i P ) 

where spins Tj, are quenched couplings Tj, taking values ±1, 

In our hamiltonian there are Cj^ different choice of - ■ ■ i p ) and consequently 
different couplings r^...^. We consider restriction 

E fa...O a = aN ( 10 ) 

In the bounds of this restriction, which means an weak correlation, all Tj are distributed 
independently, with the same probabilities 

T h-i p — with probability 1 — aN/C^ (11) 

1 i TYl OiN 

T h ... ip = ±1 with probability — - — — F (12) 

On U authors considered only conditions (|TT]) , (p!2|) . Our restriction (|1(]) simplifies cal- 
culations. As a results finite size effects are changed only in paramagnetic phase 

Let us consider, as in 0, common distribution of M energy levels. 

We have M configurations with the values of spins a®,< a < M and values of energy 

E a . 

Let as define 

P(E 1 ■ --Em) =< 5(E 1 - H(a])) ■ .-5{E M - H(af)) > (13) 
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If it would be possible to calculate. Case with 



M = 2 



N 



(14) 



Then we could calculate 

< In Z(r,T)> [ J] dE a P(E 1 ---E 2N )\nJ2 exp(-BE a ) (15) 

a=l a=l 

We have derived ([Dousing the fact that our system has only 2 N levels of energy. 

That's why we have considered Z as a function of energy levels E a (instead of-as a 
function of couplings r). Then, due to our choice (^0|)-(|l^),P(£'i ■ ■ ■ E M ) factorizates. 

Using Fourier representation for 5 function 



P(E 1 ---E 



Mj 



2N dE„ 



n 

a=l 



2tt 



■cxp 



M 



a=l 



(16) 



Let us use standard representation 



exp (aa) = cosh(a) [1 + tanh(a)er] , 



;i7) 



where a = ±1. 

We can derive, expanding 



M 



;is) 



JJ [cosh(Ei) + m sinh(Ei)] J[ cosh(K) [l + t&nh(E a )a^ ■ ■ ■ o? 

i\---i v a=2 

the expression for the P{E\ ■ ■ ■ E M ) 

/ioo , r ~ n *i aN dE 

{ cosh(£i) + mwak{Ex) cosh(£q) ■ • •cosh(E M )} TT — -e^« EaEa 
-ioo 11 J ' „ i Z7T 

(19) 

in the expression we neglect by effects of order 



£ (a?, a?" <~ a 



(20) 



l<ii—<i p <N 

We can consider this expression as a scalar product between 2 configurations). 
Let us calculate ( p0|) for the case, when only 1 turned spin, it is ease to derive 

N-2P 



K-i - c p N z\) /C 

4 



N- N 



(21) 



We see, that corrections disappear for the choice 



2 



When the number of turned spins is 5k, we have expression like 

1 



(22) 



-C8N 



N 



(23) 



In future calculations we using expression (|i~9f ) for P{E% . . . Em)- Then accuracy of one 
expression is polynomial or exponential (by N). We call this corrections as "finite P 
corrections" . Their investigation is a very hard work. 

In the next section we calculating finite size effects for the model fll5D,(fL9D using the 
formula from |l j 

oo 

< InZ >= r'(l) - J lnte-^0 (24) 



where 



=< e~ tz > 



It is easy to derive, taking Z = e , equation 



a = r'(i) - / ud 

oo 



„U+A 



2 Pharamagnetic Phase 

In this phase, as well as in the spin-glass case, we taking m = 0. 
It is easy to derive 



dE 1 dE 2 E^+aNlncoshEi-te- 3 ^ 

2tt 



Let us make transformation 



(25) 



(26) 



(27) 



x = e 



~ BE \ Ex = BE 



(28) 
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After this easy to derive 



iOO , _ oo 

dE 



2tt 

ico 



-x+(E-l) lnx-UE+aNlncosh(BE) 



dE 
2^ 



T(E)e 



-UE+aN Incosh(BE) 



(29) 



In this integral integration loop passed pole zero from right side. 
For the integration we must lift integration loop righter, until saddle point, defined 
by equation 



tanh(BE) 



U 



aNB 

Doing this we must take care for contribution of intersected poles. 

To calculate thermodynamic limit it is enough to take account poles 0, —1 

2 jv 



1-e 



Using formula (^4j), we derive 



U+aN In cosh B 



exp 



U+N In 2+aN In cosh B 



< In Z >m N In 2 + aN In cosh B 



Let us take in to account finite size effect. The saddle point gives 



1-e 



U+aN In cosh B 



T(E)e 



-EU+aN lncosh(RE) 



e _ e U+aN IncoshB _|_ j^/^j\ e -(E+l)U+aNlncosh(BE)coshB' 
-U+aN In cosh B+N In 2+<p(U) 



So we found connection between and U = In t 



hi(p = U + U + <p(U) 



where 



(30) 



(31) 



(32) 



(33) 



(34) 



U = -(JVln2 + aA^ln cosh B) 
ip(U) = T(E)exp[-(E + 1)U + In cosh(BE)/ cosh B] 



(35) 
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Let us express U by In 

u « - In 4> - U - (p(U ) (36) 

With such accuracy 

oo 

<\nZ> = y"lnt(e^0) 
o 

= aAHncoshE + iVln2 + r (£ 7 ) e ^^+i)m«+ain[co B h(BE)(oo B hB)«] (37) 

In the last expression we have neglected preexponent besides T(E). The next subphase 
appears, when saddle point E coincides with point-2: 

„. a In cosh B + In 2 . , 

tanh(25) = (38) 

aB 

The equation about subphase of paramagnetic phase demands more careful discussion. 



3 Spin-glass phase 



In this case it is enough to intersect only one pole E = 
After transformation we have 

ioo+i?o 



exp 



1 + — / dEV ( E)e ~EU +a NlncoMBE) 

— ioo 



W2tt 

where h = V aNB and for E we have equation 



exp(-E Q U + aN In cosh(BE Q ) + N In 2) 



(39) 
(40) 



tanh(BE ) = U/aNB (41) 

Let us express again U by ln0 

In « E C/ + aiV In cosh(.RE7o) + iV In 2 - - In TV (42) 

2 

1 , , aiV, , ,„„ x AHn2 1 InTV . 

U « — In + — In cosh(5£ ) + -=— - x -=- (43) 



In this formula we deal with expressions like BEq and U/B. 

In cosh + ln2/a IniV ln< 
tanh(SEo) = -| '— - - — - + 



BE n 2aNBE aNBE 



If we neglecting the last terms in ([44]) then we have 

Where at B c disappears entropy. For corrections we have (x = BE ) 

In AT 



(x tanh a; — In cosh x — ln2a) 
x = Xq — 



2aN 

(coshxo) 2 In N 



x 2aN 

1 B 

U = aNB tanh x = aNB tanh x In N— 

2 B r 



For the free energy we receive 



1 B 

< In Z >= aNB tanh B c IniV 

2 B r 



So at phase transition point free energy has jump 



2 



as for the case fully connected model 

4 Ferromagnetic Phase 

For we have expression 



2™ -1 

e v ~ '■"■"■<<■ ■■- 



« G(U)G(U) 

where 



and for i?o we have equation 



i _ cosh J BEo|r(E )| c _ i;oC/+ajVlllcosh(i?jEo) ^ < Q 
2^ 



coshjj£ , o|r(E )| ^_ £ ; o ^ +ajVlneosh(B£ ; o) £ > q 



tanh(££ ) ( 



aNB 
8 



Similarly for G{U) 



G(U) = 



(cosh^^i) - msiah(BEi)) 



(51) 

Y(El) Ig-EiU+aN ln[cosh(BBi)— msinh(BEi)] ^ ^ q 



cosh BEi — m sinh BE 1 



I T (£1 ) I e~ El U+aN ln [cosh(BEi )-m sinh(B£i )] 



and for Ei 



mt&nhBEi — m U 



1 — mtanhi^i 



Let us define function 



/(*) 
g(x) 



l+I, 1 + x 1 — x . 1 — x 
■ in 1 in 



1 + m 



l + m 



1+x, 1+x 1—x, 1—x 
In 1 In h In 2 



,E 1 >0. 
(52) 

(53) 

(54) 
(55) 



Simple calculations give 



- E U + aN In cosh(BE ) = -aNg(x) 
-E^ + aN\ncosh(BE 1 ) = -aNf(x) 



(56) 
(57) 



We wont to calculate corrections 



< In Z > -aNBm = J G{U) [l - G{Uf N ~ l 



It is convenient to break integration interval 

—Uo —Ui 00 

I = 



Where 



-00 -Ui -Ui 



U = aNBm 



(58) 



(59) 



(60) 



and 



Ui = aNBxi 



(61) 
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The value of x\ defined from equation 



agxi = In 2 (62) 

In the first integral we see the condition of dominance of ferromagnetic free energy 
under spin-glass expression: 

ag{m) >ln2 (63) 

The main contribution to the finite size correction comes from second integral. 

We have two subphases. In the first out to saddle point is in the integral of integration, 
in the second one-out side. 

I ~ exp [— aNf(— Xx)] , x\ > x 2 (64) 

and 

/ ~ exp [-aNf(-x 2 ) - aNg(x 2 ) + N In 2] , x 1 > x 2 (65) 
where for x 2 we have 

1 — v 1 — 

x 2 = (66) 

m 

Our expression (|64|) , (|65|) coincide with known results of information theory 



5 Summary 

We have calculated finite size effects for Derrida model with weak connectivity. 

In the spin-glass phase we recived logarithmic corrections, in paramagnetic-expotential. 

In ferromagnetic phase at T = our results coincide with information theory (the 
results of random coding). That codes give for the value of connectivity near the critical 
extremal possible suppression of decoding error probability. For strong connectivity the 
result is unknown for optimal coding. 

Unfortunally known boundaries from information theory show, that Derridas model 
does not give extremal suppression for the case or high values of connectivity (weak 
velocity). To clarify situation, we need consider finite P corrections. 
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In the work [IIJ,[]TT] has suggested to consider 

< \<n(T,T N )\ > T (67) 
instead of magnetization at T = 0, where T N = ~ In 7^ 

° ' JV 2 1— m 

Neglecting finite P corrections we received the same result for the exponent, as for 
the case T = 
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Appendix A 

In this appendix we show, how transform our results for the case of full connectivity 
and derive results of |]. 

For this purposes we introduce coupling J > 0, so we consider 



■tpj 



1 ~ 27J%) S ^ii..*p) 



+ 



aN 
2C P N 



1 + m . T . 1 - m . 

-^—0{jh... ip - J) + — — 6{j h ...i p + J) 



For this purposes it is just enough to replace B — ► i? J, 5 C — > £> C J 
It is easy to cheek H, that transition to full connectivity means 



a — > oo 



(A.l) 



(A.2) 



For us it means 



r dE , . 



JV( JBEY 



(A.3) 



We consider the case m = 0. 

Different expressions for e _< ^ depends on the poles, intersected by our loop for saddle 
point intergation at E — 2U/X 2 and the last depends on the temperature. It is easy to 
derive ( |A.3| ) directly. 
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